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DETAILED ACTION 
Response to Amendment 

1 . This action is responsive to the Amendment filed on 23 July 2007. Claims 1-22 
are pending, of which Claims 1,2,4,6,7-13,19, and 20 have been amended. 

Applicant's arguments with respect to claims 1-22 have been considered but are 
moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

Claims 1-22 are rejected under 35 U.S.C. 103(a) as being unpatentable over 

Ludwig et al (Ludwig) (US 2003/0225832) in view of Yogeshwar et al (Yogeshwar) (US 

7,035,468). 
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Regarding to claim 1, Ludwig discloses a system for archiving a collaboration over a 
network, the collaboration having plural cotemporaneous media streams, each media 
stream having different media type and at least one media stream having a different 
start or stop time from another media stream (see abstract, par. 0041 , 0184), the 
system comprising: 

an input adapter operable to accept each media stream of the collaboration over a 
network interface (see fig. 20, collaboration multimedia workstation software, par. 0122); 
an archive engine operable to accept the cotemporaneous plural media streams of the 
collaboration from the input adapter and to format the plural media streams of the 
collaboration for storage as a session (see par. 0046) by appending each of the plural 
media streams with time-relationship data that identifies a time relationship between the 
plural media of the collaboration (see par. 0045-0046); an archive database operable to 
store the session created by the archive engine; and an output adapter operable to 
retrieve two or more media streams from an archived session for replay of the 
collaboration by accessing elements of the stored session in accordance with the time- 
relationship data (see par. 0042, 0237; fig. 31 D (205), audio/video storage server). 

Ludwig discloses substantially the invention as claimed however does not 
explicitly disclose wherein said archiving engine. However in the same field of invention, 
Yogeshwar discloses an archive engine operable to accept the plural media of the 
collaboration from the input adapter (see title-abstract, col. 3, lines 20-33). Therefore it 
would have been obvious to one of the ordinary skill person in the art of networking at 
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the time of the invention to combine the teaching of Ludwig with Yogeshwar for 
archiving and retrieving multimedia collaboration over a network. Motivation for doing 
so would have been that archiving reduces object maintenance and improves the 
performance of active data (see Yogeshwar: col. 6, lines 1-3). 

Regarding claim 2, Ludwig discloses the system of claim 1 further comprising a 
scheduling engine operable to schedule the input adapter for communication with the 
plural media streams of the collaboration (see fig. 29-Multimedia Document 
Management, par. 0171, 0172). 

Regarding claim 3, Ludwig discloses the system of claim 1 further comprising a 
bookmark engine interfaced with the archive engine and operable to set temporal 
bookmarks in the session (see par. 0174, par. 0208-0209), wherein the output adapter 
is further operable to retrieve an archived session for replay at a bookmark (see par. 
0246, par. 0174, par. 0219). 

Regarding claim 4, Ludwig discloses the system of claim 1 further comprising a speech 
recognition engine interfaced with the archive and operable to convert audio media 
stream into a transcript (see par. 0246, fig. 30, par. 0287). 
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Regarding claim 5, Ludwig discloses the system of claim 4 wherein the speech 
recognition engine is further operable to provide a temporal map of speaker identity 
over the duration of the collaboration (see par. 0287). 

Regarding claim 6, Ludwig discloses the system of claim 1 wherein the plural media 
stream comprises a visual presentation having plural pages (see par. 0173-0174) and 
wherein the archive engine is further operable to associate other media stream of the 
session with a page of the presentation (see fig. 30, par. 0173, par. 0174). 

Regarding claim 7, the combination of Ludwig and Yogeshwar discloses the system of 
claim 1 wherein the archive engine comprises (see Yogeshwar: abstract): an audio 
engine operable to format audio information for archiving (see Yogeshwar: fig. 3, col. 11, 
lines, 17-45); a video engine operable to format video information for archiving (see 
Yogeshwar: col. 1 1 , lines 17-45, fig. 3); a structured events engine operable to format 
structured events for archiving; an application specific engine operable to format 
application specific information for archiving; and a temporal engine operable to append 
the time-relationship data to each of the plural media streams (see Ludwig: par. 0045- 
0046, Yogeswar: fig. 2, col. 10, lines 19-44). 

Regarding claim 8, Ludwig et al teach a method for archiving a network collaboration 
having plural cotemporaneous media (see abstract) streams, each media stream having 
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a different media type at least one media stream have a different start or stop time from 
another media stream (see abstract, par. 0041, 0184), the method comprising: 
interfacing with the network to receive the plural media streams (see abstract, par. 002); 
formatting each of the plural media streams for storage as a temporally related session 
by appending each of the cotemporaneous plural media streams with time-relationship 
data that identifies a time relationship between the plural media streams of the 
collaboration (see par. 0045-0046); storing the session in an archive database; and 
retrieving two or more media streams from of the stored session in accordance with the 
time-relationship data for replay of the collaboration (see par. 0045-0046, 0246, 0174). 

Ludwig discloses substantially the invention as claimed above but does 
not explicitly discloses wherein said formatting the multimedia for storage and storing 
the session in an archive database. However in the same field of invention, Yogeshwar 
discloses wherein said formatting each of the plural media for storing in an archive 
database (see abstract, col. 3, lines 20-33). Therefore it would have been obvious to 
one of the ordinary skill persons in the art of networking at the time of the invention to 
combine the teaching of Ludwig with Yogeshwar for formatting the multimedia and 
storing the sessions in an archive database. Motivation for doing so would have been 
that it helps to manage different formatting files before storing in an archive database 
(see Yogehwar: col. 3, lines 7-13). 
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Regarding claim 9, Ludwig discloses the method of claim 8 wherein the plural media 
streams comprise audio, video and application specific media streams (see abstract, 
par. 0041-0042). 

Regarding claim 10, Ludwig discloses the method of claim 9 wherein the application 
specific media stream comprises a shared application document (see par. 0042). 

Regarding claim 11, Ludwig discloses the method of claim 8 wherein the plural media 
streams comprise a structured events media stream (see fig. 23, par. 0141). 

Regarding claim 12, Ludwig discloses the method of claim 1 1 wherein the structured 
events media stream comprises instant messages (see par. 0069). 

Regarding claim 13, Ludwig discloses the method of claim 1 1 wherein the structured 
events media stream comprises e-mail (see fig. 2B, par. 0062, par. 0238-0239- 
Multimedia mail). 

Regarding claim 14, Ludwig discloses the method of claim 8 wherein interfacing with 
the network further comprises initiating communication with an archive engine as an 
endpoint of the collaboration (see par. 0076, par. 0078). 
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Regarding claim 15, Ludwig discloses the method of claim 8 further comprising: 
inserting a bookmark into the session to provide a temporal reference (see par. 0174, 
par. 0208-0209); and retrieving the archived session at the temporal reference with the 
bookmark (see par. 0246, par. 0174, par. 0219). 

« 

Regarding claim 16, Ludwig discloses the method of claim 8 further comprising: 
transcribing audio media of the collaboration (see par. 0186); and storing the 
transcribed audio media in the archive temporally related to the audio media (see par. 
0187). 

Regarding claim 17, Ludwig discloses the method of claim 16 further comprising: 
identifying voices associated with the transcribed audio media (see par. 0188-0199, par. 
0288); and visually depicting the identified voices along a time line of the collaboration 
(see par. 0188-0199). 

Regarding claim 18, Ludwig discloses the method of claim 17 wherein retrieving 
selected portions further comprises retrieving portions of the collaboration associated 
with a temporal voice identification (see par. 0216-0217, par. 0288). 

Regarding claim 19, the combination of Ludwig and Yogeshwar wherein Yogeshwar 
further discloses the method of claim 8 further comprising: associating temporal display 
of a document during the collaboration with contemporaneous information of one or 
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more of the plural media streams (see col. 17, lines 36-50); and indexing in the archive 
the temporal display of the document and the contemporaneous information of the one 
or more plural media streams (see abstract, col. 1, lines 43-55, col. 2, lines 33-43). 

Regarding claim 20, the combination of Ludwig and Yogeshwar wherein Yogeshwar 
further discloses the method of claim 19 wherein retrieving selected portions further 
comprises retrieving the document and the indexed contemporaneous information of the 
one or more plural media streams (see col. 5, lines 60-65, col. 9, lines 56-63). 

Regarding claim 21, the combination of Ludwig and Yogeshwar wherein Yogeshwar 
further discloses the method of claim 20 wherein the indexed contemporaneous 
information comprises audio information (see abstract, col.1, lines 45-55). 

Regarding claim 22, the combination of Ludwig and Yogeshwar wherein Yogeshwar 
further discloses the method of claim 20 wherein the indexed contemporaneous 
information comprises video information (see abstract, col.1, lines 45-55). 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 
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A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Umar Cheema whose telephone number is 571-270- 
3037. The examiner can normally be reached on M-F 8:00AM-5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William Vaughn, Jr. can be reached on 571-272-3922. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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